Location:
Search - java crawler
Search list
Description: java爬虫，用于爬取App的相关数据，已经试验过，很好用-java reptiles crawling App for relevant data, and has been tested, easy to use! ! !
Platform: |
Size: 7168 |
Author: 谢琦 |
Hits:
Description: java的爬虫程序，爬取的是39医药的信息，主要是药品信息，存储在mysql中。-Java crawler, crawling 39 medical information, mainly drug information, stored in the mysql.
Platform: |
Size: 17408 |
Author: zhouyang |
Hits:
Description: HTML Crawler written in Java code
Platform: |
Size: 25628672 |
Author: bunchy |
Hits:
Description: java实现的爬虫，可以依据相应主题以及给出的种子网页爬取网页。-java achieve reptiles can crawl web pages based on the topic and given seed.
Platform: |
Size: 1102848 |
Author: 陈某人 |
Hits:
Description: Nutch 是一个开源Java 实现的搜索引擎。它提供了我们运行自己的搜索引擎所需的全部工具。包括全文搜索和Web爬虫。 尽管Web搜索是漫游Internet的基本要求, 但是现有web搜索引擎的数目却在下降. 并且这很有可能进一步演变成为一个公司垄断了几乎所有的web... -Nutch is an open source Java implementation of the search engine. It provides all the tools we need to run our own search engines. Including full text search and Web crawler. Although Web search is a basic requirement for roaming Internet, the number of existing web search engines is declining, and this is likely to further evolve into a company that has a monopoly on almost all web...
Platform: |
Size: 573440 |
Author: xujj |
Hits:
Description: 基于java语言的微博爬虫程序
Based microblogging java crawler language-Based microblogging java crawler language
Platform: |
Size: 36864 |
Author: 王爱沉 |
Hits:
Description: Java实现的网络爬虫,可以自己修改要检索的信息，进行网络爬虫搜索-
Search link]Java web crawler (spider) source
Platform: |
Size: 2752512 |
Author: huawenqing |
Hits:
Description: java爬虫工具，多线程爬虫工具，可以更改可其它的主题爬虫，这里面主要是爬取jar-Java crawler tools, multi-threaded crawler tools, you can change the other subject reptiles, which is mainly crawling jar
Platform: |
Size: 27648 |
Author: 张小贱 |
Hits:
Description: Java 爬虫，实现按照关键词爬取图片，可设置爬取数目，并下载在指定目录下，可设置分辨率大小-Java crawler, according to keyword crawling pictures, you can set the number of climbing, and download in the specified directory, you can set the resolution size
Platform: |
Size: 557056 |
Author: 马冲 |
Hits:
Description: Java作为互联网开发的主流语言，广泛应用于互联网领域，本课程使用java技术为大家讲解如何编写爬虫程序爬取网络上有价值的数据信息。(Java, as the mainstream language of Internet development, is widely used in the field of Internet. This course uses Java technology to explain how to write crawler programs and crawl valuable data information on the network.)
Platform: |
Size: 2392064 |
Author: 千莫
|
Hits:
Description: 网络爬虫为搜索引擎从万维网下载网页。一般分为传统爬虫和聚焦爬虫。
传统爬虫从一个或若干初始网页的URL开始，获得初始网页上的URL，在抓取网页的过程中，不断从当前页面上抽取新的URL放入队列，直到满足系统的一定停止条件。通俗的讲，也就是通过源码解析来获得想要的内容。
聚焦爬虫的工作流程较为复杂，需要根据一定的网页分析算法过滤与主题无关的链接，保留有用的链接并将其放入等待抓取的URL队列。然后，它将根据一定的搜索策略从队列中选择下一步要抓取的网页URL，并重复上述过程，直到达到系统的某一条件时停止。另外，所有被爬虫抓取的网页将会被系统存贮，进行一定的分析、过滤，并建立索引，以便之后的查询和检索；对于聚焦爬虫来说，这一过程所得到的分析结果还可能对以后的抓取过程给出反馈和指导。(Web crawlers Download Web pages from the world wide web for search engines. Generally divided into traditional reptiles and focused crawler.
The traditional crawler starts from one or several "initial URL, the initial URL on the page, in the process of crawling, continuously from the current page from the new URL queue, until the system must stop condition. Popular speaking, that is, through the source code to get the content you want.)
Platform: |
Size: 22528 |
Author: xiaoxiao12345
|
Hits:
Description: 一款不错的用于java语言的爬虫框架，编程简单方便,编程人员不需具备较好的功底也能轻松使用(A good for Java language crawler framework, programming simple and convenient, programmers need not have a good foundation, but also easy to use)
Platform: |
Size: 111616 |
Author: 记不住昵称
|
Hits:
Description: WebCollector是一个无须配置、便于二次开发的JAVA爬虫框架（内核），它提供精简的的API，只需少量代码即可实现一个功能强大的爬虫。WebCollector-Hadoop是WebCollector的Hadoop版本，支持分布式爬取。(WebCollector is a JAVA crawler framework (kernel) that does not need to be configured and easy to develop for two times. It provides a streamlined API and implements a powerful crawler with a small amount of code. WebCollector-Hadoop is the WebCollector version of Hadoop, which supports distributed crawling.)
Platform: |
Size: 23157760 |
Author: 夏诗怡
|
Hits:
Description: Web crawler project on java
Platform: |
Size: 272384 |
Author: paneer
|
Hits:
Description: 通过配置文件中 的配置 可以爬取相关网站的内容(You can crawl the contents of the relevant web site by configuring the configuration file)
Platform: |
Size: 38912 |
Author: 天真无邪6
|
Hits:
Description: 对于我们当代的大学生来说，就业一直以来就是我们应届毕业生的一大难题，如何用最快的时间获取最有效的招聘信息，成为我们关注的焦点。
本课题正是为适应广大应届毕业生的需求，并分析了近几年内网络爬虫技术的研究和发展，对网络爬虫相关技术进行了分析与总结，使用Java语言、SQL Server数据库以及HTML的页面解析工具Jsoup，设计了一个简单的主题爬虫模块，最终实现了对河北师范大学就业信息网上现场招聘会的招聘信息的采集入库功能。(For our contemporary college students, employment has always been a major problem for our graduating students. How to get the most effective recruitment information with the fastest time has become the focus of our attention.
This topic is to adapt to the needs of the majority of graduates, and analyzes the research and development in recent years, the web crawler technology, the web crawler technology are analyzed and summarized, the use of Java language, SQL Server database and HTML Jsoup page analytical tools, design a simple crawler module. The final realization of the Hebei Normal University employment information online recruitment recruitment information gathering function.)
Platform: |
Size: 542720 |
Author: lalami
|
Hits:
Description: 小说爬虫程序，能够爬取免费小说全本，需要手动更改网站地址和小说第一章，如果追求精准还可以自己改过滤部分过滤非小说部分(The crawler program is able to crawl away the free novels and manually change the website address and the first chapter of the novel. If we pursue precision, we can also change the filtering part to filter the non fiction part.)
Platform: |
Size: 1024 |
Author: SHIELD_
|
Hits:
Description: java基于httpclient开发的网络爬虫通用实例，带登录后获取数据(Java based on httpclient development of a common example of web crawler, with login to obtain data)
Platform: |
Size: 1024 |
Author: chenguanlun |
Hits:
Description: Java for web crawler
Platform: |
Size: 1040384 |
Author: Rimbun |
Hits:
Description: Java网络爬虫,可以爬到你想要的数据，如果你喜欢的话，可以下载来看看(Java web crawler that can crawl to the data you want)
Platform: |
Size: 2768896 |
Author: 飞丽一个 |
Hits: